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CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] This invention is related to U.S. Patent No. 6,646,762 to T. Balasubramanian, 

et al. for "Gamut Mapping Preserving Local Luminance Differences", the contents of which 
are incorporated herein by reference. 

FIELD OF THE INVENTION 

[0002] This invention relates generally to gamut mapping systems and methods, and 

more particularly, to a gamut mapping system and method in which luminance compression 
varies across different parts of the image. 

BACKGROUND OF THE INVENTION 

[0003] Color printing devices and display devices are inherently limited to a range of 

reproducible colors, sometimes referred to as the color gamut. Because such image 
reproduction devices are non-ideal, they cannot reproduce every possible color that can be 
seen by a human. Gamut mapping is often required because the color range that is possible to 
reproduce with one device is conunonly not identical with the color range possible to 
reproduce with another device. Thus, while displays and printers have a large number of 
colors that are reproducible by both types of devices, there may be certain combinations of 
sets of color values that are outside the reproduction capability of one or the other. 
[0004] Gamut mapping is a well-known problem to be dealt with in color 

management systems. Input image colors must be mapped to the gamut of the output device 
in a way that preserves the intent and appearance of the image. An important component of 
gamut mapping is compression of the luminance dynamic range of the image to that of the 
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output device. Standard approaches apply compression algorithms that are independent of 
image content (see, for example, K.M. Braun, R. Balasubramanian, R. Eschbach, 
"Development and Evaluation of Six Gamut-Mapping Algorithms for Pictorial Images", 
Proc. IS&T/SID's Color Imaging Conference, pp. 144-148, 1999). These approaches can 
result in undesirable trade-offs between contrast and detail in the shadows and highlights. 
Some recent algorithms (see, for example, G.J. Braun, M.D. Fairchild, "General-Purpose 
Gamut-Mapping Algorithms: Evaluation of Contrast-Preserving Rescaling Functions for 
Color Gamut Mapping", Proc, IS&T/SID's Color Imaging Conference, pp. 167-172, 1999) 
use image content to select a compression function that is applied globally to the image. The 
same trade-offs still remain, though perhaps to a lesser extent. 

[0005] When reducing the luminance range of an image to suit that of an output 

device, there is an inherent trade-off between overall image contrast, and detail in the 
shadows and/or highlights. A compression function that preserves or enhances contrast will 
generally sacrifice shadow and highlight detail, and vice versa. The preferred reproduction is 
a complex trade-off between these two aspects, and one that depends on image content. 
[0006] Consider for example the function shown in Figure 1, denoted Lcompl. This 

function can be described as follows. We first define a function f(Lin): 

f(Lin) = Uax * (1 - (1 - Lin/Uax)^) (1) 

where y > 1 is a selectable parameter. Function f(), shown as the dashed curved line in 
Figure 1, is the inverse-ganmia-inverse (IGI) function, and has been used successfully in 
previous work for luminance compression. Assuming that the reproducible lightness range of 
the output device is from Lbiack to Lmax, a hard-clipping function is then applied: 

Lcompl(Lin) =f(Lin) iff(Lin)>Ulack (2) 

= Lblack if f (Lin) < Lblack 

Lcompl is shown as the dark solid line in Figure 1. For reference, the identity function is 
shown as a dashed straight line. Note that the overall effect of Lcompl is to compress the 
range [0-Lmax] to the range [Lbiack-Lmax]- Also, Lcompl will generally preserve or enhance the 
image contrast. However, all L* variations in the range from 0-Lbiack in the input image will 
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be destroyed, since these are all mapped to the same output, Lbiack- Thus shadow detail is 
likely to be diminished or destroyed with Lcompl. 

[0007] The function Lcomp2 shown in Figure 2 is the same as Lxompl, except for a 

modification at the dark end to smoothly approach the device black point. This function thus 
softly compresses the low luminance region, and preserves shadow detail in the lightness 
range O-Lbiack- However, this is accomplished at the expense of contrast in the dark and 
midtone regions. The two functions Lcompl and Lcomp2 exemplify the classic trade-off 
between preservation of contrast and shadow detail. 

[0008] N. Moroney, "Local Color Correction Using Non-Linear Masking", Proc, 

IS&T/SID's 8^^ Color Imaging Conference, pp. 108-111, 2000, proposed a method in which 
the output of a low-pass filter is used to drive a variable gamma function applied to the input 
pixels. Shadow pixels are processed with a gamma close to 0.5 (thus lightening these areas), 
while highlight pixels are processed with a gamma close to 2 (thus darkening these areas). 
Midtones and areas of high local contrast are passed through with little alteration. Moroney' s 
method applies a transformation that depends only on image characteristics, and not on any 
particular output device gamut. Also, a variable gamma approach can still significantly alter 
the image - a characteristic that is potentially dangerous. 

[0009] U.S. Patent No. 6,646,762 to T. Balasubramanian, et al. for "Gamut Mapping 

Preserving Local Luminance Differences" describes a system and method in which spatially 
varying gamut mapping techniques can significantly reduce the trade-offs and compromises 
found in pixel wise techniques. What is needed is a luminance compression algorithm for 
gamut mapping that varies across different parts of the image, spatially adapting the 
luniinance compression function according to the local image characteristics in such a manner 
as to preserve both shadow detail and overall image contrast. 

SUMMARY OF THE INVENTION 

[0010] A system and method for gamut mapping includes a luminance compression 

algorithm for gamut mapping that varies across different parts of the image. In shadow 
regions, a soft compression function is applied to bring out the detail. In other regions, 



-3- 



including areas with high local contrast, a hard clipping function is applied to preserve local 
contrast. The algorithm adaptively blends between these two functions to ensure that the 
overall compression function is spatially smooth. The system and method may also use 
chrominance information to compute "perceived lightness", to be used as input to the low- 
pass filter. Also, the blending function oc() could be a function of chrominance as well as 
luminance. 

[0011] A gamut mapping system, according to one aspect of the invention, includes an 

image processing module for transforming an input image into a luminance component Lin 
and chrominance components, Ci and C2; a spatial low pass filter, responsive to Lin for 
outputting a filtered luminance component Lf; and a luminance compression module 
responsive to Lf and Lin for outputting a compressed luminance signal Lout that is within the 
achievable luminance range of an output device. In one embodiment of the invention, the 
luminance compression module combines two compression functions Lcompi(Lin) and 
Lcomp2(Lin) via a blending function a(Lf). For example, Lout may be computed according to 
the relationship Lout = cx(Lf) Lcompl(Lin) + (1 - oc(Lf)) Lcomp2(Lin). 

[0012] The function Lcompi niay be optimized for preserving overall image contrast 

and the function Lcomp2 may be optimized for preserving shadow detail. Various blending 
functions may be used. For example, a(Lf) may be a piecewise linear function, determined by 
two breakpoints, Bi and B2. One particular example of a blending function has the values: 
a(Lf) =0 for values of Lf between 0 and B\ ; a(Lf) increases linearly from 0 to 1 for values of 
Lf from Bi to B2; and a(Lf) = 1 for values of Lf between B2 and Lmax, where Lmax is a 
maximum luminance achievable by the output device. 

[0013] The system and method may also use chrominance information to compute 

"perceived lightness", to be used as input to the low-pass filter. In accordance with another 
embodiment of the invention, the luminance compression module, responsive to the 
chrominance components Ci and C2, in addition to Lf and Lin, outputs a compressed 
luminance signal Lout that is within the achievable luminance range of an output device. Also, 
the blending function a() may be a function of chrominance as well as luminance. In 
accordance with another embodiment of the invention, the system may further include a low 



-4- 



pass filter, responsive to Ci and C2 for distinguishing shadow regions in the image and for 
outputting a filtered chrominance component Cif and Cir; and wherein the blending function 
is a function of luminance and chrominance a(Lf, Cif, Car). 

[0014] Various low pass filters may be used, for example, a constant weight filter. 

Additionally, the image may be down-sampled prior to filtering and upsampled and 
interpolated after filtering. A color correction module for transforming Lout, Ci and C2 to 
CMYK for printing may also be included. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0015] Figure 1 is a graph of a luminance compression function, Lcompl (the IGI 

function combined with hard-clipping); 

[0016] Figure 2 is a graph of a luminance compression function, Lcomp2 (the IGI 

function adjusted at the black point); 

[0017] Figure 3 is a block diagram of system for gamut mapping; and 

[0018] Figure 4 is a graph of an exemplary blending function. 

DETAILED DESCRIPTION OF THE EMBODIMENTS 

[0019] For purposes of the following discussion, the input image is assumed to be in a 

luminance-chrominance color space such as CIELAB or YCbCr (if not, it is easily transformed 
into such a representation). Here the term "luminance" is being used generically to 
encompass the strict colorimetric definition of luminance (i.e., the Y component in XYZ), as 
well as lightness (e.g., the L* component in CIELAB). Similarly, chrominance is used 
generically to describe the two opponent color dimensions, red-green and blue-yellow. 
[0020] Figure 3 is a block diagram of a system for spatially varying luminance 

compression for gamut mapping according to one aspect of the invention. An input image in 
CIELAB space includes three components: luminance component Lin, chrominance 
component Cun and chrominance component C2in. The input luminance component Lin is 
processed through a low-pass filter 20. This filter serves to distinguish large shadow areas 
from the rest of the image. It has to be small enough that shadow regions are passed through 



as low luminance, and large enough to filter out the detail in high-contrast regions. The 
output of low pass filter 20 is filtered image Lf, which is applied to blending function a(Lf) 
30. 

[0021] Many different spatially varying blending functions may be used. A simple 

example of a blending function a(Lf) is shown in Figure 4. Referring to Figure 4, a(Lf) is a 
piecewise linear function, determined by two breakpoints, Bi and B2. a(Lf) is: 0 for values of 
Lf between 0 and Bi; increases linearly from 0 to 1 for values of Lf from Bi to B2; and 1 for 
values of Lf between B2 and Lmax- 

[0022] The output of the blending function is then used to blend the two compression 

functions Lcompl and Lcomp2 in adaptive blending module 40 in as follows: 

Lout = oc (Lf) Lcompl (Lin) + (1 - a (Lf)) Lcomp2(Lin) (3) 
Note that the blending function a(Lf), and hence the final luminance compression varies as a 
function of spatial coordinates. Module 50 provides the color correction transform (including 
3-D gamut clipping and conversion to CMYK). Lout and the Cun and chrominance component 
C2in are input to module 50 to produce the printer specific color out. 

[0023] Referring to equation (2), note that in shadow regions, Lf is small, a is close to 

zero, and the soft compression fiinction Lcomp2 predominates. In all other regions (i.e., mid- 
tones, highlights, and regions of high local contrast), Lf increases as does a (Lf), and the 
clipping function Lcompl begins to predominate. Thus the luminance compression is adapted 
to suit the local spatial characteristics of the image. 

[0024] The compression functions Lcompl and Lcomp2, the filter function (module 

20) and blending function (module 30) can be co-optimized to achieve the desired emphasis 
on clipping vs. soft compression. Hence the system and method of the invention effectively 
provides a "knob" with different degrees of emphasis on contrast vs. shadow detail. 
[0025] There are several ways to increase the efficiency of the low pass filtering 

operation of module 20. For example, a constant weight filter can be implemented as a 
running average, keeping track of only one row or column of the pixels covered by the filter. 
Furthermore, the image can be down-sampled prior to filtering (thus significantly reducing the 
filter size) and upsampled and interpolated after filtering. 
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[0026] The system illustrated in Figure 3 may be modified to take advantage of 

chrominance information in addition to luminance (as suggested by the dashed lines in 
Figures). The Helmholtz-Kohlrausch effect predicts that the perceived lightness of a 
stimulus increases with chroma. Thus it might be desirable to use the chrominance 
information to compute "perceived lightness", to be used as input to the low-pass filter. 
Referring to Figure 3, chrominance components Ci and C2 may be provided to low pass filter 
module 20 (or to a separate low pass filter module) for distinguishing shadow regions in the 
image and for outputting a perceived luminance component Lc- In this case, Lf and Lc would 
be applied to blending function 30 and Lout is a function of Lf and Lc. 

[0027] In accordance with another embodiment of the system and method of the 

invention, Ci and C2 are applied to low pass filter module 20 for distinguishing shadow 
regions in the image and for outputting a filtered chrominance component Cif and C2f. In this 
case, the blending function a() is a function of chrominance as well as luminance, i.e., a(Lf, 
Cif, C2f). This blending function may be substituted in equation (2) for calculating Lout- 
[0028] In accordance with another embodiment of the system and method of the 

invention, the functions being blended can provide 3-D gamut mapping, rather than 1-D 
luminance mapping. 

[0029] The system and method of the invention applies a function that depends on 

both image characteristics and the output gamut. If a high quality image is to be rendered to a 
high-quality printer with a large dynamic range, the invention will not alter the image 
significantly (since the compression function in Equation 1 will approach an identity 
function). The system and method of the invention can be used in any printer or print driver 
that allows processing of multiple scan lines of an image. 

[0030] The invention has been described with reference to particular embodiments for 

convenience only. Modifications and alterations will occur to others upon reading and 
understanding this specification taken together with the drawings. The embodiments are but 
examples, and various alternatives, modifications, variations or improvements may be made 
by those skilled in the art from this teaching which are intended to be encompassed by the 
following claims. 
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[0031] The claims, as originally presented and as they may be amended, encompass 

variations, alternatives, modifications, improvements, equivalents, and substantial equivalents 
of the embodiments and teachings disclosed herein, including those that are presently 
unforeseen or unappreciated, and that, for example, may arise from applicants/patentees and 
others. 
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